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ABSTRACT 

The English language achievement of 213 Spanish 
speaking students in grades K-3, who receive .English as a Second 
Language (ESL) instruction in the context of a bilingual program, is 
compared to that of 10U similar students who receive ESL instruction 
within ±he traditional school program, in order to probe whether 
enrollment in a bilingual program retards the ^learning of English as 
a second language. ESL achievement, as measured by listening and 
reading comprehension test^ is compared through ANOVA and partial 
correlation analysis wiTEa^^guasi-experimental evaluation design. 
Anlaysis of data indicates thdrt students learning English in a 
bilingual program l^rn just as much English as students learniir^ it 
through ESL classes ViiJvi^i a traditional curriculum. Because the 
amount of areasured EnglishXachievement in kindergarten and first 
grade is found disapj)ointing compared to the substantial achievement 
measured in second and third grades, two questions are raised - that 
of the effectiveness of language instruction in K-1 and that of the' 
appropriateness of the techniques used to measuzfe achievement on 
these leve*ls. Although the study needs replication with other- -age 
groups and other languages, the implication derived from the study is 
that half-day bilingual prograrms dp not' inhibit Engllish language 
achievement in pirimary-^ged. cfti^idren. (Author/AH) 
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Children enrolled in an Illinois bilingual program typically are exposed 
t6 approximately 25% less English during the school day than their cSunter- 
parts in traditional school programs. This raises fears among some educators 
£yDid parents that enrollment in a bilingual program might retard the learning 
of English as a second language (ESL). To probe this, pre-post test data 
were collected in three cities during a five month interval in 1972 on the 
ESL achievement of 213 kindergarten through third grade Spanish-speaking 
children taught ESL within the context of a half-day bilingual program and 
104 similar children receiving' ESL instruction as part of the traditional 
school curriculum. ESL achievement, as measured ^by listening and reading 
comprehension tests, is compared through ANCOVA and partial correlation 
analysis within a quasi«-exp^rimental evaluation Resign. Analyses indicate 
no statistically significant difference in ESL achievement between the two 
groups. The implication of these results is thao half-day bilingual programs 
do not inhibit English language achievement in primary-aged children. 
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The most obvious educational n^ed for children with limited fluency in 
English who live in continental United States is to learn more English. To 
this end, at least four didaqt^p policies have been tried. 

The easiest poJ.icy to implement has been simply to absorb the children 
whose knowledge of English limited into the traditional curriculum in the 
hopes that total school--day e:fposure would lead to assimilation. In schools 
wltft more than a handful of Hjulted-English-speaking children this approach 

i 

t 

has not lowered dropout rates p or raised achievement scores. 

To strengthen the total ^osure to English policy, administrators identi- 
fied limiting variables and proposed ways to eliminate them. Numerous schools 
in Texas and California, for e?cample, took similar steps to avoid what they 
perceived to be the debilitating variables. The most vzidespread measures 
included the prohibition of i^peaking a lan^age other than English in the 
classroom, in the corridor^,^ on the playground. Some well«>meaning school ad-* 
mlnistrators even went so fac as to advise parents to speak broken English at 
home to their children, rat;her than fluent Spanish, to use the most common 
example, (Krear, 1969). \^prse, many parents complied. Unfortunately, this ^ 
approach did not lower dropout rates or substantially increase test scores 
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, *Paper presented, a^ the Seventh Annual Convention, Teachers of English to 
Speakers of Other Languages. May 9-13, 1973, San Jtian, Puerto Rico. It 
benefited from critical reft^lngs by Ann Garcelon, Bilin«5ual Education Section, 
Illinois Office of Public jllps true t ion, and Marilynn B. Brewer, Psychology 
Department, Loyola Universj^iy of Chicago. 
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of English achievement either. It did, *on the other hand, inhibit fluency 
in the child's home language and increase the level of school misunderstanding • 
All in all, this approach exacted a high toll Irom children without an accom- 
paning gain in scholastic performance (Krear, 1969). Millions would be spent 
by Congress through the Natibnal Defense Education Act in an^ effort to regain 
some 'of the "foreiga''*,^ language fluency lost in great part "because of a short- 
sighted school policy to "mainstream" children. . ' 

^•Ihile the Second Uorld War \ias forcing the U. S. to reevaluate the worth 
of second-language fluency, anthropological linguists were developing a technology 

9 

of language description and* instruction x^ich would revolutionize the teaching 
* of English as a second language j[kavetsky and Itorrisoh, 1960). There subsequently 
emerged in our scliiool systems a third approach to teaching English to chfldren 
whose primary language was not English. Special courses were' designed whtch took 
into vigorous consideration the fact that the^critical legiming steps for a child 

^ who is, studying English as a second language differ from those 8tef)S involved in 

^' ' ' * ' . * ^ . \ * * 

increasing the Engfish of children who already posse® native fluency* ^ Not sur^ 

* ' ' • ♦ * ^ k ' 

prisingly, this approach (ESL, TESL, TESOL) has , been relatively effective. ^ 

y * * ' \ 

By the mid 1960 *s, /political pressures from minority ethnic groups tHrough- 

-i' t ' ^ 

out the u:S., especially among the^. Spanish-speaking J^n^the Southwest, were' re- 
• * ' * . \* 
defining the context withii\ which much ESL instruction would occur. These ethnic, 

» ' ' - c * • ' \ 

• *, 

minorities pointed to the scandalously "^high^^ropout rate of th^ir children, to 
the misplacement of grossly disproportionate numbers of their children in classes 

■ ^ ■ • ^- 

for the retarded, to their children's loss of self-esteem and .prtde in their 
first language and heritage. * ^ ^ ' 

Largely as a result of insights formed ^rlthin the non-English-speaking 

or bilingual communities, six conditions have been identified which contribute - 

• • • . 

to the hapless syndrome in whiph the limited-English-speaking child finds himself. 

* » . * • « 

First, the student does not know enough English to understand the concepts being 

ERXC taught in the classroom so he fails in his classwork. Second, when enough time 



is taken out of the school day to o/fer him intensive instruction in English, 

he slips behind in the subject-nstatter concepts of the cra^?8es he has missed., so 

he still fails when he returns to classes in mathematics, science, and social 

« 

studies. Third, if in the process of learning English Ke is allowed to forget 
his first language, he suffers alienation from his home and ethnic identity, 
irLth subsequent loss of pride in his heritage and depletion of this country's 
^ bilingual resources. Fourth, any success that he experiences while working ex- 
clusively with peers from the same ethnic and language background may not trans- 
fer ^hen he has'to associate with Anglo (black and white) Americans. Fifth, 
even if Anglo American children and teachers who have or who develop the ne cessary^ 
empathy to work successfully with limited-Englilh-speaking cliildren are incor- 
porated in a special program, children and especially teachers outside of the 
sfjecial program, with whom the bilingua^. children must eventually relate, often 
lack the sensitivity re^bired to deal successfully with children fr6m divergent 
ethttic backgrounds— no matter how well these latter speak English. And sixth, 
because of different (priorities pnd past experience with incommunicant school 
systems, Dar^ts often place grea^r value on having their children work than on 
having them receive a highL^chool diploma. 

Bilingual edx^caiion attempts to intervene in this discouraging syndrome to 
, • • . - 

effect curriculum changes which deal in a positive fashion with the educational 

needs of children with limited fluency in English. One aspect of this curriculum 

is the teaching of English as a second language. (Other components of bilingual 

education include the teaching of subject-matter concepts through the students' 

first language, the teachiife of the studentV* first language as a continuing 

concern, and the teaching of cultural herit^^.) 
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The logic us^d to justify bilingual education is by no means universally 
accepted. The most common counterargument states that the most pressing need 
for a perscm living in the U.S. is not increased self-esteem or subject-matter 
knowledge, but fluency in English^ Many educators and parents fear that ex- 
tended school exposure to the child's first language will retard his develop- 
ment in English. A child in an Illinois bilingual program typically is exposed 
to English only 75% of the school day, whereas the child who is taught ESL as 
part of the traditional school curriculum hears English virtually the whole school 
day. It is to this question of how English language achievement affected by 
bilingual programs that the scope of the present paper is limited. 

Two recent studies deseAe mention. Valencia (1971) compared the pre and 
post test achievement during a foiit month interval of mostly Mexican, Puerto 
Rlcan, and Cuban children enrolled in 15 Chicago schools. Using one-way analysis 
of variance, Valencia concluded that "the English language development of children 
with limited or no knowledge of English is being enhanced by the Itinerant ESL, 
ESL kits, and TESL programs'' (p. 64). However, since the gains in achievement 
scores were not compared to similar children who did not receive ESL, this study 
does not in any way diminish' the strength of several rival explanations of the \ 
data: that over any four-month period of living in the U.S. and being exposed to 
English, students will demonstrate some growth in English; or that the increase;^ 
maturity of the child will explain his ability to" score higher at posttest; or 
that the pretest was reactive and accounts for the posttest gains; and so 
forth (see Campbell and Stanley, 1963). Zirkel, (L972) conducted a Connecticut 
study in whicl^ he compared Puerto Rican children, first grade through third 
grade, who werd. taught ESL within a bilingual education program end children 
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who received ESL as part of the traditional curriculum. The children were 

matched according to socio^-economic status, sex, age, and exposure to English. 

f 

Most of the results showed no difference in ESL achievement among the groups. 

The advent of bilingual programs in mainland U.S. public schools has been 
a recent event, beginning in 1968 witTi ESEA Title VII federal funding. The 

principal source of funding in Illinois for bilingual programs is state re- 

«• * 

venues. Last academic year (1971-72), there were 10 state-funded* bilingual 

«». * 

programs in Chicago and 11 others. in school districts outside of Chicago. All 
of these *'doxmstate" programs were limited to kindergarten through third grade* 
This year (1972-73), there are 49 state-funded programs in Illinois, a ad double 
this number is anticipated next year. The question this study probes is raised 
with increasing frequency as schools xonsider bilingual programs as ajl alter- 
native educational model for children with limited fluency in English. 

EXPE^MENTAL DESIGHS AND SAMPLE CHARACTERISTICS 
A pretest-posttest nonequivalent control group design was used in this 
study. Included in the sample were students enrolled in ESL classes in 15 
schools of three "dot-TOState'* Illinois school districts with large total stu- 
dent enrollment as well as large Spanish-speaking enrollments. 

All 317 children included in the sample received instruction in English 
language arts as part of the regular school curriculum, and kll 317 children 
received in addition specialized ESL instruction for 30-40 minutes daily. The 
bilingual program students received the regular English instruction in the 
half-day they attended tl^jB traditional curriculum, and they received ESL as 
part of the bilingual program. Tlie bilingual program children heard, on the 
average, 25% less En^^liSh during the school day than did the children who were 
taught ESL within the traditional curriculum. It is this difference — the 
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Spanish-speaking context of ^approximately a quarter of the school day for 
children enrolled in bilingual progra^-- which we posit as the only vari- 
able substantially differentiating the ESL/bili,ngual program children from 
the ESL/ traditional program children. This statement, of course, needs some 
defense . 

Comparability of groups . 

In an attempt to establish the initial equivalency of the' tx^o comparison con- 
ditions, the following variables were examined vis a vis the twelve standard 
threats to design validity: the selection process used to designate a school 
or classroom to one of the two conditions, the pretest equivalence of the two 
groups, differential attrition in the two groups, economic level of the schools' 
studentbody, staff teaching experience, staff ethnicity, Spanish fluency of ESh 
st^ff, district size, city population, percent of Spanish-*speaking students in 
districts and sample schools, number of schools in each district, and the ethnic 
composition of Spanish-speaking students. 

Selection . The availability of comparison children (ESL within traditional 
curriculum), in additioiv to bilingual program children, within each of the 
three districts was the result of there being more children in these districts 
' iiS:ied of a bilingual program than funds to establish the programs. In each 
' . district, the niAaber of students to be included iiy the bilingiial program was 
pre-determlned^ through proposal negotiation b.etween the district and the state 
office personnel. Accordingly, the schools v/hich had comparatively higher per- 
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centages of ^fpanlsh- speaking children were given priority for ii|iclusion in the 
bilingual pro^gram. However, the restriction in numbers imposed -by limited 
funds left sotae schools or classrooms of comparable Spanish-speakirig proportions 
out of the program. These students also received ESL instruction!^ and were con- 
sidered comparison students for evaluation purposes. It must be tooted that 

9^ / 8 
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asslgnment to the two groups was not random* 

There were seven ESL/bilingual schools and etght ESL/ traditional schools • 
All students enrolled in either of these t\7o conditions who were present for 
both pretesting and posttesting were included in this study. 

Pretest equivalence . I^ile pretest scores were not used as a criterion 
for membership in either group — all students present for both pre and^post 

s 

testing were included in the study — a test of significance was run on the 
correlation between pretest scores and group membership. There x7as no stat- 
istically significant correlation betvjeen pretest scores and the two groups ^ 
with the exception of the first grade data which was significant at the .05 
level (see Tables I and II).' 

Attrition. The year began x>rith 422 (289 * ESL/bilingual and 133 ESL/ traditional) 
students, but by year's end attrition had reduced the number to 317 (213 £SL/ 
bilingual and 104 ESL/traditional curriculum). The attrition rate in the 
ESL/bilingual group was 26%, and 117. in the ESL/traditional group. 

Economic index of schools . Title I eligibility (1) was taken *a8 an indi-X 
cation of the poverty level of the sch6ol community. Of the fifteen schools 
involved in the bilingual programs, all are Title I eligible schools^ Of the 
ESL/traditional curriculum schools, seven of the eight are Title I eligible. \ 

Staff experience .' Students in both groups generally meet with three 

4 / 

adults over, the course of the day: regular homeroom teacher^ ESL teacher 

(either within a bilingual program or wijthin a traditional curriculum), and 

a teacher aide. This study groups toge^^r teachers and teachers aides. The / 

average teaching experience for the hojneroom teachers of both groups wes«4^k — ^ 

I / 
years. The. average experience of the ESL/traditional staff was seven years 

/ 

teaching (tj^o of which were in ESL), while the average teaching experience 
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of the ESL/bilinsual staff was three years (one of which was in ESL) • The 
ESL/ traditional staff had, on the average, somewhat over double the teaching 
experience of the ESL/bilingual staff. 

Staff ethnicity . Of those teachers and aides working in the ESL/traditional 
curriculum, six were of English-speaking background and two were of Spanish- 
speaking background. The ESL/lAlingual staff included two froiti Anglo back- 
grounds and eight from Hispanic backgrounds. All the homeroom teachers were 
Anglos. 

Fluency in Spanish . None of the homeroom teachers spoke Spanish. All the 
staff teaching in the bilingual program were fluent in Spanish. Of the, ESL/ 
traditional curriculum staff, four were fluent in Spanisfi and four Were not. 
A separate analysis of the data was made to determine whether there was, a 
significant difference in the achievement of those HSL/ traditional curriculum 
students who had ESL teachers fluent, in Spanish was 

t 

Data on the size of the three districts and the cities' population, their 
concentration of Spanish-speaking students, the number of schools in each 
district, and the ethic qqmposition of the districts' Spanish-speaking stu- 
dents is contained in Table II. Tuo differences between the two groups is evi- 
dent. The districtwide percentage of Spanish-speaking students varies widely. 
On the other hand, the means of the 15 schools in our sample are completely 
comparable, although the standard deviations 3q vary. This indicates that there 
is more variance 'within district scores' than 'between district scores'. 
The other difference between the two groups is in the ethnic national .makeup of 
the Spanish- speaking students (Mexican, Puerto Rican, Cuban). This fact has 
not seemed to produce any observable effect on test scores, and the generalize- 
ability of the results is consequently enhanced. 

10 



InstrumeatatloiS r The inadequacy of standardized tests for measuring 
achievement of minority children is v;idely appreciated (T^rlghtstone, n.d.; 
Fitzgibbon, n.d.j Havassy, 1972; Zirkel, 1972; Wilson, 1973). 
All .of the shortcomings of these instrtiraents are exacerbated vxhen the 
testee's first language is not the language of the test. To gain a measure 
of ^ the tests' homogeneity with Illinois' multi-ethnic Spanish-speaking children, 
Kuder-Richardson 20 reliability was computed for each of the instruments used 
in this study. Their reliability, calculated on data from several hundred K-3 
Latin children besides those included in the present study, ranged from .54 
to .81. Table III presents this data in some detail. 

Since reliability is partly a function of the number of test items, 
those instruments where only half the items were administered (see below) did 
not achieve as high a reliability as one usually expects from commercial 
tests. Nonetheless, test reliabilities were sufficiently high to have reason- 
able 'confidence in their results. A detailed replication study of instrumenta- 
,tion effects of a dozen different tests, based on a sample of 5,000 Spanish- 
speeking children in Illinois, is currently being conducted by the authors. / 

Data collection . Pre and post tests of English language achievement 
(along with tests of Spanish language, mathematics, and self-concept, which 
will be reported in a future paper) were given to students in both ESL/bi- 
lingual and ESL/ traditional groups in January and May of 1972. These dates 
correspond to the tenure of the first semester of implementation of a bilingual 
program in these districts. All testing was accomplished within a two-week 
period by bilingual teachers and/or aides who were not the students' regular 
teachers. For purposes beyond the scope of this study, most tests were ad- 
ministered bilingually. (That is, odd items were given In English and even' 
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items in Spanish, and vice versa). Only- 4^ie English lan^age portion of the 
data is considere4 for this study^ ^ 

Data analysis ^ Analyses of data from pre and post measures to ascertain 
gain have always been a matter of controversy. Unreliability of tests, sta- ' 
tistical regression to the group mean phenomenon, and correlation between gain 
scores and pretest scores are the thtee major problems in the analysis of such 
data. 

Analysis of covariance (AHCOVA) and partial correlation analysis are two 
of the techniques suggested for overcoming these difficulties. However, it 

\ 

should be noted that A^ICOVA has been criticized for under ad jus ting for regression 
effects (Campbell ^nd Erlebacher, 1970a). Users of ANCOVA should recognize 
the procedure of adjustment available (Lord, 1968) and some cautions that are 
to be maintained (Campbell and Erlebacher, 1970b). Partial correlation analysis 

criticized for its inability to correct for differences among groups arising 
from non-randomization (Lord, 1963; Brewer, Campbell CranoV 1970 
Some adjustments in covariance appropriate to different evaluation designs have 
been suggested (Porter, 1973). Research is underway to taxonomize methods to 

measure change in terms of practical applicability (BalasubYamonian) . 

> 

The present experiment is a si^tuation where the covariat^ is fallible 
due to the imperfect reliability of the pretest measure^ and there is a ^ 
•possibility of a systematic difference on the covariate due to non-random 
assignment. As a procedure of cro^s-va^idatiotx, both ANCOVA and partial 
correlation analysis were performed, and Lord's ^technique of adjustment was 
applied^to) the second and third grade data, us ing^ verbal and non-verbal 
intelligence scores as additional covariates. 

\ 



DESIGN VALIDITY 

Campbell and Stanley (1963) identify eight potential threats to internal 
validity and four threats^ to external validity In any experiment. Internal 
validity asks the que^ion pf whether the treatment made a difference in the 

experiment; external validity asks how generalizable are the experiment's re- 

. ^^^^ 

suits. A brief review %f ^ihe inforjoation presented in the preceding section, 
in terms of ^e potential threats to va/idity, will facilitate an evaluation of 
whether the results of this experiment can be interpretable. 
Internal validit y. 

Sitice both groups shared the same school districts during the same time 
span, any artifact caused by history (events occuring between the two test 
periods) could be expected to be shared by both groups. The possible confoimd 

which might be speculated due to the differential experience and ethnicity of 

^ > * 
the teaching staff is mitigat^ed by the fact that each st^udent recelve/^struc- 

, tion from at least three teachers. 

, Maturation (growing older) and testing (the effect of taking a test on 
test scores) are ^ke\^ise controlled because they would not operate differen- 
tially between the two groups. 

Instrumentation ■ threats (changes in the calibration of a test or tester) 
are minimized by »having used standardized instruments whose reliTOllity has 



been calculated, and by using a variety of test administrators "^f or both groups. 
Testing usually topk two days to accomplish and the administrative procedures 
were the same for both groups. Test7retest effects wer6 not determined; a 
separate study in progress will do this* 

Regression artifacts (nqrmal regression toward the group mean upon re- 
testing) are ruled out for several reasons* Flr^t, students were not selected 
on the basis of pretest scates. I^hatever statistical regression does occur 

7 • ' ' 

jsShould be present equally in both groups. Further, the pretest equivalence 

13 



ERIC 



-13- 

supports the absence of differential regression effects. The (^^al use of 



MCOVA and partial regression analysis affords yet another adju^ment, for 
possible regression effects. . 

Since randomization did not occur, selection is a serious po^ntial 
threat to Internal validity. To be compared, the students In both ^oups 
should be the product of the same selection process. In this study, ^election 
was a function of attendance by classroom^ and/or building. The cutof flpolnt 
that determined vhlch schools would implement bilingual programs was to'^ 
considerable extent the result of the limited availability of funds. The. 
, pretest scores of the two groups did not differ significantly. The teaching 
experience of the staff favored somewhat the ESL/traditional classroom sett^nc;. 
School size, concentration of Spanish-speakinj students, numbers of staff 
Involvement in ESL, geographical location of schools, Spanish fluency among 
the ESL staff, did not substantially differ between the groups. ^7e feel the 
plausibility of selection artifacts to be minliaal. |t 

Experimental irfortallty (differential attrition from the two groups) appears 

to be comparable in terms of rate of attrition. This does not rule out bias 

V. 

in the type of student who left the two c^roups, but we are t^aware of any 
syateniatic bias that would not be true across both ESL/blllngual and ESL/tradi- 
tional sdhools. 

The final threat to internal validity, interaction effects amon<; any of 
the seven other threats, appears esftremely unlikely f>lven the preceding Informa- 
tion. ' 



External validity . 

The threat of interaction of testini^ and treatment is not controlled by 
this design. It is, however, somex^^hat contained by the fact that most of the 
students' Immediate school environment is exposed to the same condition and 
tesCins is an accepted school activity. At any rate, the generallzablllty of 
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the results is not meant to extend beyond children learning ESL in the settings 
in which they were tested (i.e., bilingual programs or traditional programs). 
A desi<>n variation in which random schools within both groups would have the 
pretest omitted would offer a control for this confound. 

The threat of interaction of selection and treatment is partly diffused 
by our willine:fiess to limit the applicability of the results to students 
who would have been eligible for both ESL and bilingual pro^jrams on the 
^primary school level. This eligibility is based largel^y on lan<^uage need. 
There is an apparent danger in extending the interpretability of the results 
beyond the type of child who might have attended one of these two Illinois ^ 
programs. On the other hand, the mulj^ethnic nature of Illinois' Spanish- 
speaking populatioji is ideally suited to generali2in<» across Ppanish-speaking 
groups. There Is^the possibility that the schools which successfully requested 
for bilingual programs had administrators who were more open to the educational 
needs of limited-English-speaking children. Our experience has been mixed iS^ 
this regard, and we do not think that there is a strong, systematic bias favoring 
bilingual program children for this reason. 

The third threat to external validity Campbell and Stanley call reactive 
Arrangements . These would be especially serious in articial experimental con- 
ditiottg. This reactive effect might tend to favor a child who envisioned 
himself in an "exotic' or especially prestigious program. It is doubtful that 
this was the case with the two gijoups reported in this study. At any rate, 
the-results are not meant to be generalized beyond the described conditions, 
however . reac tive . 

final threat to the generalizability of an experiment's results, 
"multiple treatment interference , raises the question of what would happen 
to the English language achievement^ of either group once the continuous 




nature of the ESL is substantially altered in structure, as in the case of 
an alternate-days, rather than daily, program. The present study does not 
generalize beyond a daily treatment effect. The carry-voer power of ESL 
instruction has not been probed here, 

The appropriateness of this nonequivalent control group design for the 
c ire urns trances in which it was employed is judged by the authors to be capable 
of providing, eminently interpretable data. The few instances of possible bias 
cancelled each other out by their contrastive directiotj. The two groups 
seen remarkably similar. 

The question raised txs>, tfi#title of this paper is whether bilingual educa- 
tion programs inhibit English language achievement. 

To probe this question, English language achievement di 213 Spanish-speaking , 
students in grades K-3 who received ESL instruction in the context of a bilin- 
gual program was compared to that of 104 similar students who received ESL in- 
struction within the traditional school program. Tables 4, 5 a^"6 present the 
ANCOVA results of the three grade levels* Table 7 presents the results of partial 
correlation analysis for the three grades. 

An. e:iamination of the tables indicates that in both types of analyses, re- 
gardl^s 0? grade level, the students studying ESL performed equally whether they 
were leainiin<> it vjithin the context of a bilingual program or a traditional pro- 
gram. In ANCOVA, none the F statistics was significant. Similarly, in partial 
correlation analysis, none of the correlations was significant. In the case of 
second and third grade data, even when intelligence (as measured by the Inter- 
American Series Test of General Intelligence ievel II) and pretest performahce were 
partialled out simultaneously, the correlations vrere not significant. 



The results all indicate tt\at students learning English in a bilingual 
prograjia learn just as much EnglieK as students learning it through ESL classes 
within a traditional curriculum. " 



mBJalCkyiO^S FOR FURTHER STUDY 
Tlfe educational significalce of the amount of measured English achievement 
in kindergarten and first grade i$r disappointing, while the achievement measured 
in second and third grades appears ^Substantial. This raises at least two questions: 
the effectiveness of language instruction in K-1, and the appropriateness of the 
techniques, we used to measure English achievement on these levels. The answer more 
likely lies with the measurement techniques. It was especially difficult to test 

r 

children of this tender age. 

It is frequently argued that language ability, especially on the K-3 level, 
is principally a matter of oral skills; and oral ability ,should be measured through 
tests which evoke oral responses and are in themselves oral. There is no philo- 
sophical quarrel yrith this position. The economics of testing force the investi- 
gator to choose between a large sample tested on listening and reading comprehen- 
sion items, or a small sample tested through taped oral responses. Prompted^^byj — ^ 
expediency, and encouraged by the high correlations between the briefer written 
form of the MLA Proficiency Test ai^d the longer form with an oral component. 



our oral tests opted for a large number of children answering questipns of known 
reliability. A controlled study using direct measures of oral language, would be 
a distinct^ contribution to the literature. 

It may be argued that the reason for the "no signif icant^ddffference between 
comparison groups" is that the posttest results were the product of some pre-bilin- . 
gual program learning which was still exerting its effect. Since the tested 
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Interval covered oi^ly four iapnths time, this rival explanation of the data has 
mild plausibility^; jk longitudinal study should elucidate this issue, and one is 
currently being^ohducted by^th? authors. 

Can this "study's f landings be extended to other language groups and to children 
of other ag^s?'' We would, hypothesize a yes to both questions, but there is a need 
to replicated this study's findings in other language and age groups. 

Would the resrolts have been the same had we compared students studying in 
a traditional English language arts program (not ESL) to similar students studying 
ESL within either a traditional academic setting or within a bilingual program? A 
controlled study should elucidate tflis, too. 

There is klways difficulty "proving" a null hypothesis. It should be noted, 
hovi^ver, thax the use of covariates substantially increased the power of the 
anal^^ds to detect small differences had tthey been there. Nonetheless, in spite 
of the questions we have raised, the overwhelming implication of this study is 
that a student learns every bit as much English in a bilinsual program as he does 
in a traditional all-English school program. When one adds to this the other 
educational objectives of a bilingual program, there is ample reason to regard 
bilingual progratns with spirited interest. 

f. 
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Correlations between student measures and group membership 



PRE ENG. 
POST ENG. 
GROUP 



DF » 99 



PRE 
ENG. 



.25 



.05 j 



POST 
ENG. 



,16 



PRE 

' ENG. 



POST 
ENG. 



GROUP 



GROUP 



KINDERGARTEN 



PRE ENG; 
POST ENG. 
GROUP 



.27 



.11 



.17 



FIRST GRADE 



DF « 104 ' 



r 1 



ERJC 




dK* 108 



PRE POST GROUP PRE POST 
ENG. ENG. / V.I." N.V.I. 



PRE ENG. 










POST ENG. 


.79 








GROUT 


.04 


.13 




4 


PRE -v. I. 


. 33 . 


» 

■ .27 


.14 




PRE N.V.I. 


.34 


.30 


.08 


.40 



SECOND AND THIRD 
GRADES 



/ 

/ 



N> 



M 
CO 



UI 

o 
o 
o 



V 



CO 



to 



f 



c 

n 
O 

n 
or 
o 
o 



«0 

H 



OP 

cr 

M 
(0 



to 



to 



O O 



iA> CO 

o> u> u> 
)^ ^« 

o •Tj a: 
• • fl> 



00 

O 
<x> 



to 



to 



o 



C/5 H 

o w ^ 
o r* 
t3 *^ 




H 












2 *^ 




















i 








CO 


































O 


1 o 







+ W CO 

^ w o o 
1 h3 w 



CO 



M O 



O M 

t n 



CO 

r> 
ft 

f& 
cu 

rt 

SD 

O 

a. 
rt 

H 
H- 

O 



o 
B 

P 

& 



rr 



to 



ERIC 



V 



23 



O • — -H 

m a: 2 m 
2 J> H «/> 
m 00 m -H 

— r* 
> r* r- o 
r- — — -n 

o o 

j> m o 

o 2 m 
o 2 
m m 



5 



— — m 

2 CO 
O H -H 
m m 

3: 50 
m m 

50 > 

o — 

> 2 

2 er> 



.2 
O 
. 2 
J 

m 

50 
00 

> 



2< 


r- 


</> 


< 


cz m 


m 


•p 


o 


3: 50 


< 


m 


o 


m 00 


m 


m 


> 


30 > 




o 


CO 


— f 






cr 



-< 



m H 
X m 

CO 
m -H 

50 

— O 

m -Ti 

2 

o w 
m 5» 
V) in 
f — 
r- o 



2 
O 

o 
m 





-o 






:?» > 






a> 


O Q. 


o a 


O cx 


50 




-t 






-I 










3 fl> 


3 O 


o 








v» o 


w> n 








o 


<0 






<» 


2. 




3 










ft 


rt 


rr 





m -I 

X m 

•o </> 

m -H 

50 

^ O 

rn •n 

2 

oco, 

m > 

CO c/> 

7^ o 



> 

2 

o 
c:- 
> 





ls> 




to 




N> 








o 


O 




o 


O 


O 


O 
















*^ 




\n 





o 





• 












00 




o 




ro-- 


u> 




00 ^ 


ro 




<A vn 




CO VI 


V> VI 




ro 




o • 




o • 


o • 


o • 






• 








vn 






o 












o 






o 








*•* 










ro 


ro 


ro 


ro 


M 




00 


00 


ro 




v» 


VI 


VI 




o 


VD 




KR 


KR 


50 


KR 








ro 


fO 


ro 


ro 






ro 




o 


o 


o 


o 


o 




o 


o 








• 


• 






• 




VI 


CO 


VI 






\n 


VI 




VI 


«>>• 




vo 




VI 


VI 






























« 






vn 


in 
























^ 00 


C^ 



m 



— c: 
•n cj 

> m 
2 CO 



50 
m -< 
r- -c 
— m 

CO o 



-< 



CO 

m 



50 H 

m < 
J— -o 
— m 
> 
CO o 



tn 



•c 
c 

00 



in 
X 



50 
m 
•c 
o 

50 
H 
m 
O 



2 
O 



> 



0. 



z 
c 



I 
-< 
•o 
O 
H 

■o: 
m 
</> 
.•"^ 

in 





i> 2 




O 
















-* -n 


e 


-n 




^ m 








' m 








o 




I —4 m 




, X 


H 


> 








u o o 








, > <r> 




;» 






•4 


s> vo 




-H m 




m > 




</> -1 








m 












in 




> 




-n 








i m 




70 




ERIC 



25 



rim 



,4* 



t1 



4^ 



z 
c 



X 

-p 

O ' 
-4 

ICO 5 



^ m 

o'?o . 
m 

i-< o 

-4 m 
X. 

> 
ox 

< 2 

>o 

73 

^ -4 

H m 

mi> 

Im 

h 

'to 
m 



« # # 



im 



* im 

^ •-• -n 

^ O 

* H 

* m 
4^ i 



# 
I 
I 
t 
f 
J 
I 
I 
I 



» m 



1 :c 



!-i 

I 

*l -« m 
i 

I e O 



I 
I 
I 
I 
I 
I 
i 
i 



;c3cj rf\ 



im 3j 

' n m 



it 



o 

.(/» 

im 



e 
o 



I ! 

1 : I 

■ i 1:^ . 
il 



O 

c 

o 



♦ ?5 

♦ 'm 



i 


. 1 

, 1 


1 

1 

i 


1 




f 


1 


1 


1 


i 

IS 


t 1 


no 




1 1 












i 1 


* ' 




{ 




lui 


\ 






\ 




1^ 


I 




t 







I 
t 
I 
I 
f 
I 
I 

I • 
I 

I i 



J* 

I* 

is*' 



3: 

!2: 



• 



'.I 

I 

.1 



I 
t 
I 
I 

t 

J 

8 

I 
I 



09 

.ro 



I 



# # 

I* 



C 00 

mo 
m 

CO 



^1 



o 



}# « • 

I* 

, o 

♦ 

# # « 



I i 

IS! 

I v>>i 



c 

u I 

o </> 



\ 58 



# 

;# 

I* 



t 

09 

O 
Hi 

n 

1 



0) 



!vo 



I 
I 



3e 
m 

• ''<^ 

c 

}>* 

m ' ♦ 
» # # #•* 



ERIC 



26 



4: 



i 



O 



X 

o 



[</> 



C 

CO 



H 
X 

o 

<; 

50 



m 



a 

Tl 

•n 
m 

TO 

m 

z: 
o 
m 

3: 
o 

m 
> 
-I 

m 
z 



m 




i 

ERJC 



27, 



o vr 

CO CO (0 

rt rr 
m ft 

w» rt 

m 

H ^ 
ft 

cf c 

"i 

H rt 
CO o> 

m 

o 
c: 
rt 



fi 
rt 



r> 
o 
»l 
»1 

0) 
ft 
H« 
O 

0) 

ft 



(9 



ft 

<I 
m 

to 0 

M 

m 

CO 



ON 



to 



CO 
4S 



00 



O 



o 



o 

•si 



o 

ON 



o 

ON 



rt- 



ON 



O 

NO 



O 



O 

NO 

0> 



CO 

M 
CO 

o 

CO 



w 

2! 



<3 
M 



as 
< 

H 



• 25 
H 



ro 
I 







(0 




CO 




c 




M 




ft 




CO 




of 




•d 




(0 








rt 




H. 


t 


0) 




M 








O 




O 




M 








(0 




H» 




0) 




ft 




H* 




O 












§. 
















0) 




H. 




CO 









H 

o 



I 

w 



CO 

H 

H 
2 



cn 
w 

H 

H 

S2S 



, CO 



W 
.CO 

H 
H 

i 

















t A 










• 




• 




« 


• 




W 


00 


00 


VO 








o 










vn 




«^ 






09 




VO 






OO 


• 


« 


• 


• 


• 


• 




to 


VO 


•to 




to 






45- 


VO ^ 


ON 




ro 


hO 












VJl 


t 


1 


t 


1 


• 


• 












vn 










o 














4:- 






» 








1 


*• 


t 


t 


• 


» 












VO 










4:- 


VO 


« 










vn 




««« 






VO 


VO 


VO 


o 




CO 


• 


« 


« 


• 


• 


• 






vn 










ro 






ts> 




N> 














as 




Va) 


VO 


^Va> 


o 






vn 







o 

ON 



o 

o 
c 



3: m t» 
m 2: po 
> o m 



3C m 
m 2S o 
> o c/> 
S r; H 

cn 



3: 0 — < 

m m z m 3? 
> z m 

3C o m CO 

m r" 3> 



! 

3: o — < t> 
m m m 59 
> 2: H 50 m 
3S o m GO 
m r- J> 2: 
r- r- o 
— 2: 
I t 



o > 3C m t> 

O C7 m 2: o 

< c > cn </> 

> c: 2 r- H 
50 c/> — 

— «H </i 

> m X 

m 

o 



m CO 
?o H 

30 > 
O Z 
30 O 

o 



29 



ro 
t 

w 



o 
m 



O 



*• 












• 


O 








VD 


O 




>J 




Q O 




0 ifi 






3 — 




mm* 


rt 




oo 


- rt 








Cn 






w 


O 






rt f-t 






o n 










ro 


to — 






^ O 






0 c 


o 




c — * 












V> rt 












CL 
















• 


c 




09 






ON 




O 




rt 






O 




K> 






CO 




1 


• 








■..3 




N> 












o 




1 


• 


Z> 




o 






vo 














a 






rt 




ro 






vn 




1 








o 






ro 


a. 












-t> 












~t 


1 


« 














O 












cn 














o 


O 







2 
m 

> 









r- 






















3: 




m 


o 


> 




:z 


-f 




m 








o 


CO 


r** 








v> 




X 






m 




> 


H pn 




m 




r- <: 




r- m 






CO 






m > 


b 


z r- 








m 


3: 


— no 


m 




> 


H m 




m 






{« 


r- o 




— z 




O t 




m <: 




2: m 




.0 30 




m CD 




> 




r- 








3 



o 
o 

0) 
H» 
ft 
D 



rt 



i 



1^ 



30 



